Toward a Cross-Case Analysis of Outcomes of Exemplary Engagements By MEP Centers

Case studies are among the most common evaluation methods, often used for program promotional efforts rather than as a systematic method for evaluating program processes and outcomes. A pilot project to produce case studies which more systematically adhere to a defined methodology was directed by Robert Yin, President of COSMOS Corporation, and funded by the Manufacturing Extension Partnership at the National Institute of Standards and Technology of the U.S. Department of Commerce. This paper presents a cross-case examination of the 26 case studies produced in this pilot project. The examination focuses on three aspects of the cases: (1) the degree to which the case studies represent “exemplary” high impact engagements, (2) the qualitative impacts of the program on manufacturing customers’ capacity for change, and (3) the addressing of counter factual, competing or rival explanations for why the high impacts occurred. The results of this cross-case analysis shows that exemplary engagements appear to have significant qualitative and quantitative benefits to the company, growth in business performance, and public benefits linked to MEP center technical assistance. Market conditions and existing business practices appeared to be important, possibly as preconditions to the manufacturers’ seeking out MEP assistance. These findings are limited by validity and reliability concerns.